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CT- 1 1  Summary-*- 

A  gradient  method  is  presented  for  adjusting  the  parameters  of  a  system 
to  optimize  a  performance  criterion.  The  partial  derivatives  of  the  perform¬ 
ance  index  with  respect  to  the  adjustable  parameters  are  obtained  as  real 
time  signals,  using  a  single  perturbation  signal  for  a  system  with  unknown 
structure,  but  favorable  topology. 

Computer  simulations  are  included  to  indicate  the  feasibility  of  the 
approach. 

The  adaptive  control  method  using  a  single  perturbation  signal,  as  pro- 

* 

posed  here,  has  many  features  in  commom  with  the  welJ-known  parameter 
perturbation  scheme. 


+ 


This  paper  will  be  presented  at  the  Sixth  Symposium  on  Adaptive  Processes 
at  the  National  Electronics  Conference,  Chicago,  Illinois,  October,  1967. 


INTRODUCTION 


A  new  perturbation  method  is  presented  in  this  paper  for  the  simultaneous 
adjustmen  by  the  gradient  method  of  multiple  parameters  in  adaptive  control 
systems.  The  significant  advantage  of  this  method  is  that  only  one  perturba¬ 
tion  signal  is  needed  to  generate  the  gradient  of  a  performance  criterion  which 
is  a  function  of  all  of  the  adjustable  parameters.  This  results  in  a  consider¬ 
able  saving  in  time  and  equipment  over  the  conventional  perturbation  methods 
which  use  a  separate  perturbation  for  each  parameter  adjustment.  At  present 
the  method  has  only  been  shown  to  work,  for  systems  with  a  favorable  topology, 
where  the  adjustable  gain  parameters  feed  into  a  common  summing  Junction 
that  is  linked  with  the  system  input  by  a  single  subsystem,  as  shown  in 
Figure  1.  This  is  not.  however,  necessarily  overly  restrictive  since  a  control¬ 
ler  v/ith  adjustable  parameters  often  can  be  constructed  with  this  structure 
even  though  the  plant  itself  may  not  have  a  structure  suitable  for  this  perturba¬ 
tion  method. 

The  single  perturbation  signal  method  is  an  outgrowth  of  the  model  methods 
of  gradient  generation  |JL,  2]  ,  It  was  shown  previously  [2]  that  in  a  truly 

adaptive  situation,  where  much  of  the  structure  of  the  system  is  unknown  and 
a  model  cannot  be  constructed,  that  the  system  could  be  used  as  its  own  model 
by  feeding  back  the  appropriate  error  signal,  attenuated  and  delayed  beyond 
the  autocorrelation  time  of  the  system  signals.  In  this  paper  the  idea  of  using 
the  system  as  its  own  model  is  extended  further  by  the  demonstration  that  a 
multiplicative  perturbation  signal,  which  is  uncorrelated  with  the  major  system 
signals,  can  be  used  in  place  of  the  time  delay.  Furthermore,  it  is  shown  that 
such  conventional  techniques  as  the  well-known  sinusoidal  perturbation  method 
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Q3,  4]  exhibit  significant  features  in  common  with  the  method  presented  here. 

First  it  is  shown  that  a  single  perturbation  signal  can  generate  the  signals 
necessary  for  the  correlation  technique  construction  of  the  gradient  of  the 
performance  index  in  parameter  space  „  Then  this  method  is  compared  with  the 
model  method  and  the  conventional  perturbation  methods.  Next  the  design  and 
stability  of  the  adaptive  loop  is  discussed  and  finally  computer  simulations 
which  demonstrate  the  feasibility  of  the  method  are  presented. 


PERTURBATION  METHOD 


A  performance  criterion  often  used  in  adaptive  procedures  is  the  minimiza 

tion  of  2  ,  where  the  bar  denotes  a  statistical  ensemble  average,  or  a 
6 

time  average  over  a  finite  or  infinite  time  interval.  If  k  is  an  adjustable 
parameter,  then  the  quantity  required  for  the  steepest  descent  adjustment  of 
k  is  the  gradient  component 


a  k 


e2(t  ) 

=>  -3 

e2(t  > 

3* 

«  2  e  ( t  )  t  )  . 

3k 


The  adaptive  loop  is  an  implementation  of  this  correlation  process.  The 
errov  signal  is  multiplied  by  the  partial  derivative  and  the  product  is  integrated 
and  multiplied  by  a  loop  gain  constant  b  .  The  resulting  signal  is  subtracted 
from  the  gain  k  .  The  error  e(t  )  usually  is  available  as  an  actual  signal 
so  that  the  gradient  component  for  any  particular  k  can  be  obtained  by  correla¬ 
tion  of  e(t  )  and  .  L  ,  if  this  partial  derivative  also  can  be  generated 

as  a  real  time  signal.  Even  ii  a  more  general  performance  index,  J  *  F(  e  (t)  ,  t  ), 
ia  used,  the  crucial  part  in  determining  the  gradient  is  obtaining  — 1  as 


a  signal. 
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It  is  shown  now  that  If  the  system  has  several  adjustable  gain  parameters 

k.  ,  ( i  =  1  ,  , . .  ,  m  )  ,  then  the  partial  derivatives  3e [ t  1  each  appear 

3kt 

at  the  inputs  to  the  respective  gains  k^  .  These  desired  signals  are  imbedded 
within  the  normal  system  signals  at  these  points  and  must  be  extracted  for  »se 
in  the  adaptive  loops . 

The  convolution  integral  representations  of  the  signals  e(t  )  ,  x(t  )  , 
and  y  (t  )  in  the  linear  time  invariant  system  shown  in  Figure  1  are 

or 

e(t  )  «  /  H(  s  )  e(t-s  )  ds  ■  H*x 


yt(  t  )  «  h^x  ( 1  ) 

m 

x(t  )  »  u  +  g*  (  £  k,  y.+  e  p  e  )  , 

i«l 

where  H  is  the  impulse  response  between  the  input  summer  output  and  the  error 

t  / 

output  and  h^  is  the  impulse  response  between  the  input  summer  output  and  the 
input  to  the  gain  k^  ,  with  the  output  of  every  k^  open-circuited  and  with 
e  P(t  )  «  0  .  Also,  g(t  )  is  the  Impulse  response  of  the  subsystem  between 
the  gain  summer  and  the  input  summer. 

The  partial  derivatives  of  each  of  these  signals  with  respect  to  any  one  of 
the  adjustable  gains  k^  is  calculated  from  (  1  )  as 


-JLfL. 

akj 


-  h*  -4r 

■  h  *  .a JL 
1  3  k, 


m 

g*  (  e  k 
i®  1 


i 


ayi 


3k, 


+  Yj  +  ep 


3e 


3ki 


)  . 


(2  ) 
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Since  each  impulse  response  corresponds  to  a  linear  time  invariant  system 

any  sequence  of  convolutions  can  be  permuted,  for  zero  initial  conditions. 

Therefore,  equations (  2  )  can  be  combined  to  yield 

m 

V  (9*E  kiV*%  +  ’-!;>•  (3) 

1  i»l  J  J 

i 

If  the  magnitude  of  the  perturbation  signal,  ep(  t  ),  is  small  compared  with 
the  magnitudes  of  the  system  signals,  then  the  last  term  in  (  3  )  is  small  com¬ 
pared  with  the  other  terms . 

Therefore,  if  a  system  wer«  modeled  by  the  integral  equation  representation 

m 

*  "  (g*  1  kih1  )  *  2  +  ( g*H  )*y  ,  (4) 

J  H  * 


3  © 

then  z  would  bo  the  desired  partial  derivative  — — 
j  3k 


It  is  shown  now  that 


J 


(  4  )  is  an  approximate  representation  for  a  portion  of  the  signal  y^  ( t  )  ,  and 


■  "j 1  . . 

that  this  portion  can  be  extracted  for  use  in  generating  the  gradient  of  e  ( t  )  . 
Equations  (  1  )  can  be  combined  to  yield 


m 


y^  *  (g*  i  )  *  y^  +  e  g*h^*  p  (H*x)  +  h^*u  ,  (5  ) 

i«l 

Let  y  »  y  +  y*  and  x  *»  x  +  x'  ,  whore  y.  _  and  x.  are  the 

J  j  ,  0  J  0  j  /  0  0 

signals  developed  when  f  p(t)  »0  ,  Then  (  5  )  becomes 
m 


yj  -  ( g*  1  k^h1  )  *  yj  +  e  g*h^  *  p  (H*xq)  + 

If  e  p(t  )  is  small,  then  x'(t  )  is  much  smaller  than 
in  (  6  )  can  be  ignored,  which  yields 


e  g*H  *  P  (H*X*  ).  (  6  ) 
xQ( t  )  and  the  last  term 
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m 


y!  “  ( o*  i  M>,  )  *  y'  +  c  s*h  *  p  (  h*x  )  . 
J  is-i  1  i  i  j  o 


(7  ) 


If  p(  t  )  is  slowly  varying  compared  with  the  impulse  response  times  of 

hA  and  H  then  p  ( t  )  can  be  shifted  within  the  sequence  of  convolutions  in 

the  last  term  of  (  7  )  to  yield  (  g*H  )*  e  pv  .  Therefore,  (  7  )  becomes 

3  # 

identical  to  (  4  )  except  that  the  driving  function  in  (  7  )  is  e  p  ( t  )y  ( t  )  , 

j  #  0 


y  (t  )  .  Because 


whereas  the  driving  function  in  (  4  )  is  y  ( t  )  i 

p  “  0 

p(t  )  is  slowly  varying  the  output  of  the  system  represented  by  (  7  )  is  approxi¬ 
mately  equal  to  the  output  of  the  system  represented  by  (  4  )  multiplied  by 


e  p(  t  )  ,  i .e , ,  yj  -  e  p  ( t  )  z^  ( t  )  ,  or 

y  ( t  )  »  y  (t  )  +  e  p (t  ) 
J  J  #  o 


3e  ( t  ) 

liT 


(8  ) 


A  heuristic  demonstration  that 


-fr 

j 


exists  within  the  signal  y  is 


afforded  by  tho  model  method,  The  system  is  shown  with  a  model  and  without 
the  perturbation  signal,  in  Figure  2,  The  system  equations  are  the  same  as  ( 1  ) , 
with  e  "0  ,  and  these  can  be  combined  to  yield 


m 


^7“  «*  ( g*  £  k,h  )  *  2-S-  +  (g*H)*y.  * 

3  k.  ,,11  3  k,  j 


(9  ) 


3  kj  i-1  '  *  ° 

which  is  the  sarno  as  (  3  )  with  E  p  ( t  )  -  0  , 
The  model  equations  are 
f  *  H*w 


-i 


w 


*w 


(10  ) 


m 


=»  gM  e  k  z  +  e  )  , 
i-1  1  1 
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which  can  be  combined  with  (  1  )  to  yield 


m 


z  *  (  g*  E  k  h  )  *  z  +  (  g*H  )  *  y  . 

1  ,  ,  1  1  J  1 

i»l 


(11  ) 


For  zero  initial  conditions  (  9  )  and  (  11  )  gener  the  same  signal,  so  that 

.  »  3e 

J  3ki 


Now  If  e  ( t  )  Is  multiplied  by  a  low  frequency  perturbation  signal  f.  p  ( t  ) 
before  insertion  into  the  model,  it  is  claimed  that  the  new  signals  in  the  model 
will  be  approximately  equal  to  the  respective  old  signals,  each  multiplied  by 
c  p ( t  )  ,  Secondly  it  is  claimed  that  the  perturbation  signal  is  not  large  enough 
to  disturb  the  system  significantly,  and  the  system  can  be  used  as  its  own  model. 


.APAPiyE  &SHEME. 

As  in  most  adaptive  methods  using  the  gradient  technique,  the  basic  idea 
in  the  present  scheme  is  to  construct  the  gradient  of  the  performance  index 
e2(  t  )  with  respect  to  the  control  parameters,  and  then  adjust  these  parameters 
in  the  direction  of  the  negative  gradient.  In  the  model  method  the  partial  deri¬ 


vatives  are  generated  directly  as  real  time  signals  and  -^S —  is  obtained  by 

multiplying  e(t  )  and  iUtOi  )  and  integrating  the  product.  The  adaptive  loop 

S  k. 

tH  * 

for  the  i  gain  is  implemented  as 

t 

k.  ( t  )  *  k  (  0  )  -  8  /  e(s)  J ds  ,  so  that 
1  i  dK 

0  1 

the  Integration  for  the  continuous  adjustment  of  is  combined  with  the  Integra- 

2 

tion  for  the  averaging  of  e  ( t  )  , 

In  the  present  scheme  ■■  )  is  imbedded  in  the  signal  y  ( t  )  ,  (  8  )  , 
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The  extraction  of  the  partial  derivative  and  the  correlation  with  e(t  )  is 
incorporated  within  one  integration  as 


^(t  )  »  kt(  0  )  -  B6p  Yj  *  kA ( 0  )  -  $ 


ae 

e  -r—  , 


3k 


(12  ) 


i 


where  3*  *  $e  p*  .  The  simplification  in  (  12  )  follows  from  (  8  )  and  the 
assumption  that  p  (t  )  is  uncorrelated  with  the  system  signals  and  has  zero 
mean. 

In  the  usual  parameter  perturbation  schemes  for  adaptive  systems  [3,  4] 
each  gain  k^  is  perturbed  by  a  signal  P^(t  )  and  the  partial  derivatives 


all  are  imbedded  in  the  perturbed  error  signal.  It  is  commonly  assumed 

akj 

m 


2  2  2 

that  e*  -  e  +  z  o  p  — ae...  4*  n(t  )  ,  where  e*  is  the  perturbed 

i-1  1  1  ^ 

error,  e  is  the  unperturbed  error,  and  n(t  )  is  noise.  The  gradient  is  then 
extracted  by  correlation  as 


0*^  P  j  ** 


2 


t rr 


Po"  +  Z  - 

j  U1  °ip  i  pi 


iai  -  o  D2  *’2  , 

skt  j  p)-3ir 


have  zero  moan  and  are  uncorrelatod  with  each  other,  This 


where  the 

extraction  and  correlation,  however,  can  be  formulated  in  the  manner  of  the 
porturbation  scheme  of  this  papor,  too.  Thus 


ew  =e 


m  a 

+  £  c.  p.  -LS.  +  n(t  )  , 

1-1  ^i 


e*  (  p  e*  ) 


m 

(e  +  z 
1-1 


ae 

pi"Tjq“ 


PJ 


„  2  2 
2  c  p  _liL.  . 
11  a  k^ 
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ADAPTIVE  PARAMETERS  AND  STABILITY 

The  four  adaptive  parameters  of  a  system  using  this  new  perturbation  method 
are  ( i  )  the  perturbation  frequency,  w  ,  (  or  period,  T  ),  ( ii  )  the  gain  of  the 
perturbation  loop,  e  ,  ( ill  )  the  gain  of  the  adaptive  loop,  e  ,  and  (  iv  )  the 
bandwidth  of  the  adaptive  loop.  The  parameter  e  is  adjusted  so  that  the 
perturbed  system  does  not  differ  markedly  from  the  unperturbed  system  and  the 
first  term  in  the  Taylor  expansions  are  adequate  for  approximation  purposes.  Too 
small  a  value  of  e  ,  however,  requires  a  long  averaging  time.  If  only  a  single 
integrator  is  used  in  the  adaptive  loop,  then  0  determines  the  gain  and  band¬ 
width  of  the  adaptive  loop.  If  8  is  increased,  then  the  speed  of  adaptation  is 
increased  but  the  effect  of  noise  (  due  to  averaging  p(t  )e  (t  )  y^  t  )  over  a 
short  time  )  results  in  larger  excursions  of  the  parameters  from  their  optimum 
values,  as  discussed  below. 

The  choice  of  the  perturbation  frequency  w  is  decided  by  considerations  of 
stability  and  accuracy.  Generally,  uppe*  and  lower  bounds,  «  ^  and  w  , 
respectively,  can  be  found.  If  w  is  greater  than  w  ^  then  the  approximations 
made  while  deriving  the  gradient  signal  are  no  longer  valid.  If  to  is  less  than 
Wg  then  a  large  phase  lag  may  bo  introduced  in  the  loop,  which  causes  insta¬ 
bility  ,  Slow  perturbations  involve  longer  averaging  times  which  are  equivalent 
to  longer  time  delays  in  the  feedback  loop. 

At  the  present  time  no  general  method  exists  for  analyzing  adaptive  systems 
Involving  significant  adaptive  loop  and  system  intercoupling.  Therefore,  for 
purposes  of  analysis  the  adaptive  loop  gain  fl  which  controls  the  speed  of 
adaptation  is  assumed  small.  With  this  simplifying  assumption  a  stability 
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analysis  of  the  system  using  the  error  perturbation  described  in  this  paper,  is 
carried  out  exactly  as  in  the  case  of  a  parameter  perturbation  system. 

Using  the  method  suggested  by  Eveleigh  [3]  ,  if  the  index  of  performance 
can  be  expressed  as 

o  2 

ez(t)  =a^(k-kQ)  +  a2  , 

for  a  single  adjustable  parameter  k  ,  then 


3e2(  t  ) 
3k 


where  a,  and  a  are  constants  and 
1  2 


kQ  is  the  optimal  value  of  k  . 

The  signal  used  to  adjust  the  parameter  k  is  obtained  by  multiplying  the  two 

signals,  y ( t  )  =  y  (t  )  +  e  p(t  )  -ifl1  >  ,  <  8  )  ,  and  p(t  )  e  (t  )  . 

°  3k 

If  the  product  of  these  two  signals  is  integrated  over  a  sufficiently  large  time 

t 

interval,  then  the  first  term  © ( t  )  =  /  y0 (t )  p(t)e(t)dt  becomes  negligible 

o 

because  p(  t  )  is  uncorrelated  with  the  input  or  other  system  signals.  The 
second  term  is 


,  2  2 » 

;  p  (t  )  JLL. (t)  dt  :  •  c  Y  a,  l"k  "  k  ]  , 

o  2  3k  l  o 

00 

where  j.  ^(t  )  dt  -  y  ,  the  variance  of  the  Independent  random 
o 

perturbation  signal. 

If  &  is  the  gain  of  the  feedback  loop,  the  rate  of  change  of  the  parameter 
k  is  given  by 

k=  -  0eYa1(k-ko)=  -  a  ( k  -  kQ  )  ,  where 
a  *  e  B  y  .  It  is  seen  that  in  the  ideal  case  the  .parameter  k  varies 
exponentially  to  reach  the  final  value  kQ  .  In  practice,  however,  the  averaging 
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time  is  not  sufficiently  large  to  reduce  9(t  )  to  zero  and  this  term  acts  as  an 
added  forcing  function  so  that, 

k+  a  k  =  a  k  +  9  ( t  )  , 

and  the  final  value  of  k(t  )  oscillates  about  the  optimal  value  kQ  . 

In  the  multiple  parameter  case  the  same  argument  is  used  for  each  of  the  adjustable 
parameters  k^  ,  k^  —  ,  kn  ,  If  e  (t  )  in  the  parameter  space  is  repre¬ 
sented  by 

-T -  T 

e  ( t  )  =  [k-io]  P  [S.-Jf0]+  1  . 

where  k  is  the  parameter  vector,  §_  is  a  constant  vector  and  P  is  a  positive 
definite  matrix,  then  the  simplified  adaptive  loop  is  described  by  the  vector 
equation 

• 

k  «  -  B  e  y  P  [k  -  kQ]  +  9(t  ) 

t 

where  £(  t  )  is  obtained  by  the  finite  time  averaging  of  f  ( t  )  e  ( t  )  y  (t)  dt  , 

p  ■—  o 

o 

In  the  ideal  case  k ( t  )  approaches  ,k0  exponentially.  If  9,(  t  )  is  nonzero, 
the  final  value  of  k(  t  )  oscillates  in  the  vicinity  of  Jc0  . 
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COMPUTER  SIMULATIONS 

Systems  modeled  by  difference  equations  have  been  simulated  on  the 
7094/7090  digital  computer  at  Yale  University  to  illustrate  the  single  pertur¬ 
bation  signal  method  of  adaptation.  The  error  function  in  each  case  is  the 
difference  between  the  output  of  the  system  and  the  output  of  a  reference 
system  which  is  fed  by  the  same  input.  In  order  to  demonstrate  the  feasi¬ 
bility  of  the  method  the  reference  system  and  the  actual  system  are  given  the 
same  structure  so  that  the  actual  system  can  "identify"  the  reference  exactly, 
in  the  absence  of  noise.  Examples  are  presented  for  two  and  three  adjustable 
parameters  with  sinusoidal  and  white  noise  perturbation  signals,  and  with 
additive  white  noise. 

The  adaptive  scheme  used  for  adjusting  parameters  A,  B,  and  C  is  shown 

in  Figure  3a.  The  adjustable  parameter  system  has  a  pulse  transfer  function 
3 

z  ,  and  the  reference  system  has  a  pulse  transfer  function 

3  ,  2 

z  +  Az  +  Bz  +  C 
3 

_ z _  .  In  examples  1  and  3  the  parameter  C  is  fixed 

3  2 

z  -  0 . lz  +  0.2z  -  0,25 

at  -0.25,  and  the  region  in  the  (  A,  B  )  parameter  space  where  the  system  is 
asymptotically  stable  is  shown  in  Figure  3b  . 

The  input  to  all  systems  in  the  following  examples  is  a  white  noise  signal 
with  uniform  distribution  between  -0.5  and  4-0.5.  This  input  is  a  sequence 
of  random  numbers  (  generated  by  a  computer  program  )  whose  statistical  proper¬ 
ties  have  been  verified  by  direct  computer  calculation.  Furthermore,  both  the 
same  random  number  sequence  at  the  input  and  the  same  initial  settings  of  the 
adjustable  parameters  (  zero  )  have  been  used  throughout  to  provide  a  basis 
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for  comparison  among  the  different  situations. 

In  all  of  these  examples  the  performance  index  for  implementing  the  adap¬ 
tation  is  the  continuous  adjustment  of  the  parameters  with  the  instantaneous 
integral  of  the  square  error.  The  performance  index  for  evaluating  the  adaptive 
scheme,  however,  is  more  meaningful  as  the  mean  square  error,  A  theoretical 
mean  square  error  criterion  is  most  easily  used  in  calculations  if  the  integra¬ 
tion  interval  is  infinite.  Therefore,  one  index  reported  in  all  of  these  results 

is  the  mean  square  error  at  any  time  t  , 

t  t 

1  2  12 
mse.  «  r*  /  e£(  s  )  ds  =  —  Z  e  ( i  )  . 

*  ^  *  J 1  _  1 


As  time  increases,  the  values  of  this  index  approach  those  for  an  infinite  time 
average  ,  but  even  for  large  integration  intervals  this  index  depends  signifi¬ 
cantly  on  the  initial  state  of  the  system.  Therefore,  a  second  index  reported 
in  all  of  these  results  is  the  square  error  averaged  over  only  the  previous  150 
units  of  time ,  at  any  time  t  , 


mse  2 


1 

150 


/  e^ ( s  )  ds 
t— 150 


1 

150 


150 

Z  e2(t-i )  . 
i  =  0 


Since  150  units  of  time  is  much  larger  than  the  impulse  response  time  of  the 
reference  system,  (  which  is  approximately  5  units  of  time  ),  or  than  the 
correlation  times  of  any  signals  used  here,  the  index  mse 2  is  a  good  measure 
of  the  closeness  of  any  set  of  parameters  to  their  optimum  value,  for  large  time , 


EXAMPLE  1  : 

In  this  example  the  perturbation  is  a  sinusoid  of  unit  amplitude  and  period, 
T  .  For  a  specific  setting  of  the  adaptive,  parameters,  the  time  responses  of  the 
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adjustable  parameters  A  and  B  are  shown  by  the  solid  curves  in  Figure  4b  . 

After  2000  units  of  time  A  and  B  have  reached  the  values  -0,1  and  +0.2  , 

respectively  and  the  system  is  indistinguishable  from  the  reference.  This  is 

-3  -7 

corroborated  by  the  reduction  of  mse2  from  5x10  to  5x10  ,  as  shown 

by  the  solid  curves  in  Figure  4c  .  After  5000  units  of  time  mse2  is  zero  within 
the  accuracy  of  the  computer. 

It  has  been  observed  in  other  test  suns  that  the  adjustable  parameters 
approach  their  optimum  values  for  wide  ranges  of  $  and  f.  and  for  periods 
of  the  sinusoidal  perturbations  ranging  between  10  and  60  units  of  time  (  which 
is  large  comparedwith  the  impulse  response  time  of  5  units  for  the  reference 
system  )  . 

If  additive  white  noise  is  inserted  at  the  system  output,  then  the  adapta¬ 
tion  is  slower  and  subject  to  more  fluctuations,  as  shown  by  the  dotted  curves 
in  Figures  4b,  c  .  Nonetheless,  the  system  adapts  nearly  as  well  as  is  possible  , 
as  shown  by  the  eventual  approach  of  mse2  to  the  experimentally  determined 
value  for  a  system  with  parameters  fixed  identically  to  those  of  the  reference 
system . 

EXAMPLE  2  : 

For  the  same  setting  of  3  and  e  ,  but  with  the  sinusoidal  perturbation 
at  twice  the  frequency  of  that  in  Example  1,  all  three  parameters,  A  ,  B  ,  and  C 
adjust  near  to  their  optimum  values  within  3000  units  of  time,  as  shown  by  the 
dotted  curves  in  Figures  5b,  c  .  During  the  next  two  thousand  units  of  time, 
however,  there  are  drastic  fluctuations.  For  these  settings  of  3  and  T  , 
but  with  E  reduced,  the  system  adapts  at  almost  the  same  speed  and  no 
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Instability  occurs,  as  shown  by  the  solid  curves  in  Figures  5b,  c  , 

This  stable  case  with  three  parameters  corroborates  the  claim  that  multiple 
parameters  can  be  adjusted  simultaneously  with  a  single  perturbation  signal. 

The  fluctuating  case  also  supports  this  contention  but  emphasizes  the  depend¬ 
ence  of  the  scheme  on  the  settings  of  the  adaptive  parameters.  The  most  likely 
explanation  for  the  instability  with  larger  e  is  that  this  increase  in  the  pertur¬ 
bation  signal  disturbs  the  system  sufficiently  so  that  an  incorrect  gradient  is 
generated  in  the  vicinity  of  the  optimum  settings.  Thus  the  adaptive  system 
hunts  around  the  optimum  settings. 


EXAMPLE  3  : 

Despite  the  emphasis  on  low  frequency  perturbation  signals  it  is  shown 
in  Figures  6,  7  that  the  system  parameters  adjust  along  the  gradient  even  if 
the  perturbation  signal  is  broad  band  noise.  It  is  seen  by  comparing  Figure  6 
with  Figure  4,  for  two  adjustable  parameters,  and  Figure  7  with  Figure  5,  for 
three  adjustable  parameters,  that  the  adaptation  is  much  slower  and  less 
accurate  for  the  white  noise  perturbation  than  for  the  low  frequency  sinusoid. 
Yet  the  fact  that  the  perturbation  noise  is  uncorrelated  with  the  input  noise 
permits  the  adaptive  loop  to  utilize  the  low  frequency  content  of  the  perturba¬ 
tion  signal  in  the  extraction  and  correlation  process  (  12  )  ,  for  producing  the 
gradient.  As  expected  the  values  of  6  and  e  must  be  increased  to  compen¬ 
sate  for  the  lose  of  high  frequency  perturbation  signal  energy. 


Work  is  in  progress  to  determine  experimentally  and  analytically  the 
behavior  of  these  systems  for  other  sets  of  initial  conditions  and  for  wider 
ranges  of  tVie  adaptive  parameters. 
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CONCLUSION 

To  the  best  of  the  authors'  knowledge  this  is  the  first  demonstration  of 
an  adaptive  scheme  for  adjusting  many  parameters  simultaneously  with  one 
perturbation  signal,  without  the  necessity  of  using  a  model  or  an  equivalent 
system  identification  scheme.  The  method  is  limited  at  present  to  situations 
where  the  adjustable  gain  parameters  feed  into  a  common  summing  Junction, 
but  this  limitation  is  not  overly  restrictive  in  the  design  of  a  controller.  It 
is  expected  that  the  method  can  be  extended  to  certain  time-varying  and  non¬ 
linear  situations. 
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FIGURE  1.  Single  Perturbation  Signal  Schemo  for  Gradient  Generation 
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FIGURE  3a.  Adaptive  Scheme 


(0.25,  -i.0) 


FIGURE  3b. 


Stability  Region  in  (A.B)  Parameter  Space 


Figure  4b.  System  Parameters 
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Figure  4.  Adaptation  with  Single  Sinusoidal  Perturbrttioii  Signal 

(  Two  Adjustable  Parameters  ) 
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FIGURE  5a.  Adaptive  Parameters 
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FIGURE  5c.  Moan  Square  Errors 


F;IGURE  5.  Adaptation  with  Single  Sinusoidal  Perturbation  Signal 

(  Throe  Adjustable  Puramotors  ) 
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P (t) :  White  Noise,  Uniform  Distribution,  t0.5 


FIGURL  6n.  Adaptive  Parameters 
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FlUURU  6b.  System  Parameters 
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6.  Adaptation  with  Whito  Noise  Perturbation  Signal 


(  Two  Adjustable  Parameters  ) 
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fi=0.4,  e =0 . 4 

P  (t):  White  Noise,  Uniform  Distribution,  +0.5 


FIGURE  7a.  Adaptive  Parameters 


FIGURE  7c.  Moan  Square  Errors 


FIGURE  7.  Adaptation  with  White  Noise  Perturbation  Signal 

(Throe  Adjustable  Parameters  ) 
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